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The Development of Problem Solving Capabilities in 
Pre-service Technology Teacher Education 


Richard A. Boser 

Enhancing the problem solving capabilities of students and employees 
has become a national educational issue. The Commission on Pre-College 
Education in Mathematics, Science and Technology (1983) declared that 
“problem-solving skills, and scientific and technological literacy — [are] the 
thinking tools that allow us to understand the technological world around us” 
(p. v). More recent reports that have focused on entry-level workplace skills 
by Carnevale, Gainer, and Meltzer (1990) and United States Department of 
Labor (1991) [SCANS Report] also underscore the importance of developing 
students' problem solving abilities. As a result of this decade of emphasis on 
problem solving, efforts to enhance the capabilities of students to solve prob¬ 
lems have reached most disciplines and most educational levels (Birch, 1986; 
Bransford, Goin, Hasselbring, Kinzer, Sherwood, & Williams, 1986; Kulm, 
1990; Lombard, Konicek, & Schultz, 1985; Thomas & Englund, 1990). 

In technology education, teaching through problem solving methodology 
has become a central focus of instructional activity (Waetjen, 1989). It follows, 
therefore, that teachers need to be adept at using problem solving strategies in 
their classrooms and laboratories. Several recent studies highlight this need. 
Barnes (1987) concluded that problem solving should be a key descriptor for 
defining technology and a curricular organizer for the study of technology. 
Householder and Boser (1991) reported that an emphasis on problem solving 
instructional strategies was a key ingredient in assessing the effective imple¬ 
mentation of pre-service technology teacher education programs. In addition, 
research by Horath (1990) and by Householder and Boser pointed to the need 
for graduates of technology teacher education programs to use problem solving 
strategies in their classrooms and laboratories and to teach problem solving 
skills. In spite of the need to implement effective problem solving instruction 
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in pre-service technology teacher education, there is no generally accepted 
framework to guide curriculum development or assessment procedures. 

Background Ideas 

One difficulty in investigating problem solving behavior is the many us¬ 
ages of the phrase “problem solving”. McCormick (1990) noted that, depend¬ 
ing on the context, “problem solving” may mean: (a) a teaching method that 
encourages active learning, (b) a generic ability to deal with problem situations, 
(c) a method used in such subjects as mathematics or science, or (d) an em¬ 
pirical investigation. Additionally, Gagne (1985) used the term problem solving 
to describe a higher-order intellectual ability and a way of learning. 

All of these usages have implications within technology teacher educa¬ 
tion. Problem solving is clearly seen as a teaching method with links back to 
experiential learning. Problem solving may also be viewed as a way of learning 
that generates new insights and useful thinking processes for the learner (Gagne, 
1985). Further, the scientific method of hypothesis generating and testing is 
certainly at the heart of technological problem solving. In this study, because 
of the implications for teacher education, “problem solving” was limited to two 
usages. First, “technological problem solving” refers to the systematic way of 
investigating a situation and implementing solutions. Second, the “problem 
solving approach” is used to describe a teaching method that encourages the 
development of new insights and useful thinking processes through active in¬ 
vestigative learning. 

Technological Problem Solving 

Technological problem solving processes have been greatly influenced 
by the work of Dewey and Polya (Savage and Sterry, 1991). Dewey (1910) 
described a five step iterative process of problem solving that comprised: (a) 
felt difficulty, (b) clarification of the problem, (c) identification of possible 
solutions, (d) testing the suggested solutions, and (e) verification of the results. 
Polya (1957) proposed a heuristic process for solving problems in mathematics 
that provided a mental guideline for action. The steps in Polya's heuristic in¬ 
cluded: (a) understanding the problem, (b) devising a plan, (c) carrying out the 
plan, and (d) looking back — checking the results and evaluating the solution. 

Two additional influences on technological problem solving have been 
the scientific method and the idea of creative problem solving, de Bono (1990) 
postulated that the concept of the “hypothesis”, which formally sanctions cre¬ 
ativity and imagination, has been “the” idea that has powered rapid scientific 
and technological change. Wallas (1926) described the creative problem solv¬ 
ing process as involving four phases: (a) preparation, (b) incubation, (c) illu¬ 
mination, and (d) verification. More recently, Devore, Horton, and Lawson 
(1989) built upon the work of Wallas and added two additional phases: moti¬ 
vation and manipulation. 

These approaches have formed the basis for many models of problem 
solving that have been applied in technology education. Some of these models 
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retain the simple linear approach, such as the IDEAL model of Bransford and 
Stein (1984), while others, such as Barnes, Wiatt, and Bowen (1990) and 
Hutchinson (1987), have proposed more complex circular or spiral models with 
evaluation components built into each phase. 

Problem Solving as an Instructional Approach 

The problem solving approach immerses students in active, investigative 
learning (Sellwood, 1989). Through participation in a series of practical prob¬ 
lem solving activities that may involve designing, modeling, and testing of 
technological solutions it is assumed that the learner will acquire both technical 
knowledge and higher-order cognitive skills. Gagne (1985) stressed the im¬ 
portance of experiential learning and noted that abstract concepts must be built 
upon concrete situations in order to “operationalize” (p. 103) declarative 
knowledge. Andre (1986) emphasized that the importance of problem solving 
methods lies in the degree of information processing required of the learner. 

In identifying problems, searching for solutions, and presenting results, the 
learner has multiple opportunities to encode and accommodate new knowledge. 

Preparation to Teach Problem Solving 

No research was found that related training in problem solving methods 
to pre-service technology teacher education. However, Diaber (1988) noted 
many common instructional elements among “investigative delivery systems” 
(p. 166) such as problem solving, inquiry teaching, discovery learning, and 
critical thinking. Given the commonalities, research in these related areas may 
provide useful insights to teacher educators. 

A meta-analysis of inquiry teaching studies in science education by 
Sweitzer and Anderson (1983) reported that effective teacher preparation pro¬ 
cedures included: (a) systematic observation of inquiry practices; (b) micro¬ 
teaching; and (c) feedback, in which supervisory conferences were combined 
with videotaped observations. More recently, Hutchinson (1989) found that 
pre-service teachers who participated in an inquiry-oriented seminar assumed 
more active teaching and learning roles than those teachers who participated in 
a traditional seminar setting. Fernandes (1988), who compared the effects of 
explicit and implicit teaching of a Polya's (1957) heuristic model of math¬ 
ematical problem-solving, reported that both approaches significantly enhanced 
the problem solving performance of pre-service teachers. However, only ex¬ 
plicit instruction resulted in the conscious use of the heuristic. Fernandes 
concluded that in order to teach problem solving teachers must be competent 
problem solvers who are aware of the methods and processes that they employ. 

These studies support the idea that changes in ways of preparing teachers 
will result in changes in classroom performance. Moreover, as Wright (1990) 
stated, being a competent technological problem solver is, by itself, insufficient 
preparation to teach problem solving skills. Pedagogical skills and practices 
that foster students' problem solving abilities must be taught to prospective 
teachers. 
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Purpose of the Study 

Although a host of implications for instruction have been offered from 
the research on problem solving in various domains, relatively few studies have 
addressed the need to prepare teachers to teach higher-order thinking skills such 
as problem solving. Little is known about the experiences in which pre-service 
technology education teachers should participate in order to acquire the skills 
needed to be competent technological problem solvers and to use problem 
solving effectively as an instructional methodology in the secondary school 
classroom or laboratory. The purpose of this study was to develop a validated 
inventory of instructional procedures, techniques, and assessment methods that 
may be used by the profession as a framework for curriculum development and 
for the assessment of program effectiveness in the development of problem 
solving capabilities in pre-service technology teacher education programs. 

Research Questions 

Two sets of instructional practices were investigated: (a) procedures re¬ 
commended to acquire the skills needed to be competent technological problem 
solvers, and (b) procedures that facilitate the use of problem solving teaching 
methods in the secondary school classroom or laboratory. Each of the two sets 
of instructional practices was organized into three parts: (a) procedures recom¬ 
mended to develop the problem solving capabilities, (b) instructional techniques 
for putting the procedures in place, and (c) methods for assessment of program 
effectiveness in delivering the procedures. Specifically, the following research 
questions were used to guide the study: 

1. Are leading practitioners and advocates of problem solving instruction 
within the field of technology education in agreement with leading edu¬ 
cators and psychologists who are not in the field of technology education 
as to which procedures are effective in the development of problem solving 
capabilities? 

2. What procedures are recommended to develop the technological problem 
solving capabilities of prospective teachers during pre-service technology 
teacher education programs? 

3. What instructional techniques are appropriate for the delivery of the pro¬ 
cedures recommended to develop the technological problem solving capa¬ 
bilities of prospective teachers? 

4. How may the effectiveness of the procedures recommended to develop the 
technological problem solving capabilities of prospective teachers be as¬ 
sessed? 

5. What procedures should be included in pre-service technology teacher 
education programs to assist teachers in using a problem solving method¬ 
ology? 
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6. What instructional techniques provide an effective means for delivering the 
procedures designed to assist teachers in using a problem solving meth¬ 
odology? 

7. How may the effectiveness of the procedures recommended to assist pro¬ 
spective teachers in using a problem solving methodology be assessed in 
pre-service technology teacher education programs? 

Procedures 

Perceptions of effective instruction were solicited from two selected 
panels of experts in problem solving. One panel was comprised of technology 
teacher educators (TECH) who were identified as leading practitioners or ad¬ 
vocates of problem solving instruction (n = 10). These panel members were 
identified from the a group of 22 leading technology teacher educators who 
previously served as Delphi panelists in the study by Householder and Boser 
(1991). The selection of TECH panelists was based upon their interest in 
problem solving as evidenced by (a) recent research, writing, and presentations 
on problem solving instruction, and (b) rating of the importance of problem 
solving items in response to a questionnaire conducted by Householder and 
Boser. The second panel included leading educators and psychologists (EXT) 
who have published in the area of problem solving and who were not in the 
field of technology education (n = 9). 

There were two reasons for using two panels. First, expertise from out¬ 
side technology teacher education may broaden the pool of instructional pro¬ 
cedures recommended to the profession through this research. Barnes (1987), 
who indicated the need to broaden the curricular organizers of technology ed¬ 
ucation, consulted practitioners in several professions outside of technology 
education. Second, utilizing two panels provided data for comparing the per¬ 
ceptions of the experts within technology education with the recommendations 
of experts external to the field. 

Potential panel members were contacted by telephone to seek their par¬ 
ticipation in the study and to establish a convenient time to conduct the tele¬ 
phone interview. Depending on the amount of lead time prior to the scheduled 
interview, a letter confirming the scheduled interview time was either mailed 
or faxed to the panelist. Enclosed with the confirmation letter was a copy of 
the telephone interview schedule, a brief orientation to the study, and a listing 
of pertinent definitions. The interview times ranged from 10 minutes when the 
respondent had completed the survey in advance of the conversation, to 45 
minutes when the items were reviewed and recorded during the discussion. 

In semi-structured telephone interviews, panelists were asked to rate the 
relevance of an inventory of procedures (70 items) synthesized from the litera¬ 
ture, to comment on those procedures, and to suggest additional procedures that 
they considered essential in the development of problem solving capabilities. 

A 10-point scale was used by panelists to rate the procedures with a rating of 
10 indicating that the procedure was absolutely essential. A rating of one im¬ 
plied that the recommendation was not relevant. The 10-point scale was as- 
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sumed to have yielded interval data (Nunnally, 1978). This scale was selected 
because of the potential for increased reliability in comparison to scales with 
fewer intervals (Nunnally, 1978), and also because of its conversational appeal 
in an interview setting. That is, it is quite common for individuals to be asked 
to rate objects, ideas, or perceptions on a scale of 1 to 10. 

The telephone interview schedule was pilot tested with subjects not in¬ 
cluded in the research sample. The individuals who comprised the sample for 
the pilot test were teacher educators who had recently completed doctoral re¬ 
search or who had a record of publication in the area of problem solving in¬ 
struction. 

Descriptive statistics calculated for each of the 70 items included the 
combined mean score and standard deviation, the mean score and standard de¬ 
viation by panel, the frequency of rating scores, and measures of kurtosis and 
skewness. Both the t-test procedure and Wilcoxon's Rank-Sum Test were used 
to test for significant differences in the responses between the two panels. 

Results and Discussion 

Of the 70 items rated by panelists, only the instructional methods of 
“Computer Assisted Instruction” and “Lecture” received mean rating scores of 
less than 6 on the 10-point scale. Even these instructional techniques were the 
subject of mitigating comments from panelists as to their appropriate contexts 
in teaching problem solving. As a group, therefore, the procedures synthesized 
from the literature have a high degree of relevance for the preparation of pre¬ 
service technology education teachers. 

Agreement Between Panels 

Analysis of the results with both parametric and nonparametric statistical 
procedures indicated that there was no significant difference in the mean rating 
scores assigned to the items by the two panels. The overall mean rating score 
of the 70 items by the TECH panel was 8.07 on the 10-point scale. The mean 
rating score of the EXT panel was 7.76. The SD for both panels was 1.13. 

As a result of these findings, the combined mean scores of both panels (n = 

19) were used to rank the inventory items. 

Developing Technological Problem Solving Capabilities 

Recommended procedures. All 19 items in this section received a mean 
rating greater than 6 on the 10-point scale. Four procedures that emphasized 
practice in applying problem solving strategies in realistic contexts and feed¬ 
back on the use of those strategies received mean ratings of nine or greater. 
Other highly-rated items recommended that prospective teachers have the op¬ 
portunity to observe the regular modeling of problem solving behavior and the 
cognitive modeling of thinking processes involved in solving problems. The 
panelists' responses are reported in Table 1. 

Table 1 
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Instructional Procedures Recommended to Develop Technological Problem 
Solving Capabilities 

Mean 

SD 

Recommended Procedure 

9.42 

0.69 

Problem solving strategies are practiced in 
meaningful contexts 

9.32 

0.88 

Feedback is provided on the use of problem 
solving strategies 

9.24 

1.15 

Discussion questions emphasize “why and 
how” 

9.05 

0.91 

Concepts and principles are connected 
to real world application 

9.00 

1.66 

Problem solving behavior is regularly 
modeled 

8.89 

1.07 

Alternative problem solutions are explored 
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Table 1 (cont.) 


8.83 

1.04 

Realistic problem situations span the range 
of technological activities 

8.63 

1.26 

Systematic verification processes are used to 
check results 

8.63 

1.50 

Small group problem solving procedures are 
analyzed through inter-group discussion 

8.42 

1.57 

Feedback helps teachers interpret their 
experiences 

8.05 

1.71 

Problem solving thinking processes are 
regularly modeled through such practices 
as “talk aloud” methods and self-monitoring 
questions 

8.00 

1.83 

Learning activities are linked to broad 
problem situations 

8.00 

1.87 

Techniques and processes central to techno¬ 
logical activities are emphasized through 
extended practice 

7.89 

2.66 

General problem solving strategies 
(heuristics) are specifically taught 

7.79 

1.75 

Sources of incorrect procedures are 
confronted 

6.83 

2.52 

Worked-out examples are provided when 
appropriate 

6.79 

1.99 

Concepts developed through problem solving 
activities are confirmed in discussion with 
more experienced persons 

6.32 

2.31 

Prompts, such as checklists, are readily avail¬ 
able to guide problem solving performance 

6.05 

3.13 

Initial learning of strategies focuses on the 
skill rather than content 


Teaching methods. Whereas there was considerable agreement between 
the panelists as to which procedures promote the development of problem 
solving abilities, no corresponding consensus developed on which instructional 
techniques might be used to facilitate those procedures. With the exception of 
small group problem solving experience, panelists' ratings of the techniques 
appeared to reflect familiarity with the practices. Members of the TECH panel 
tended to rate most highly those procedures practiced within the field, such as 
design-based problem solving, R & D experiences, and innovation activities. 
EXT panelists considered techniques such as simulation and case study, which 
are perhaps more widely used in content areas outside of technology education, 
as appropriate delivery vehicles for the recommended problem solving proce¬ 
dures. 
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Comments by several panelists emphasized the need to use a variety of 
instructional techniques. One panel member commented that all of the in¬ 
structional techniques could be highly relevant in the proper context. Moreover, 
as a panelist suggested, practice in applying problem solving skills in a variety 
of instructional settings may facilitate transfer of those skills to novel situations. 
Variety itself may have implications for the types of activities graduate tech¬ 
nology education teachers chose to implement in their classrooms. Panelists 
ratings of the items in this section are reported in Table 2. 


Table 2 

Instructional Techniques That Facilitate the Use of the Procedures Recom¬ 
mended to Develop Technological Problem Solving Capabilities 


Mean 

SD 

Recommended Procedure 

9.29 

1.10 

Small group problem solving experience 

8.61 

1.42 

Individual problem solving experiences 

8.50 

1.29 

Simulation 

8.44 

1.92 

Design-based problem solving 

8.19 

1.97 

Cooperative learning 

7.94 

2.94 

Research and development experience 

7.89 

2.35 

Innovation activity 

7.89 

2.39 

Invention activity 

7.41 

2.06 

Community-based problem solving 

7.25 

2.29 

Enterprise (class models a corporation) 

6.71 

2.73 

Case study 

6.53 

2.39 

Self-instruction through manuals etc. 

6.50 

2.17 

Demonstration 

6.44 

2.30 

Peer teaching 

5.50 

2.09 

Computer assisted instruction (CAI) 


Assessment of program effectiveness. Of the eight assessment methods 
rated by the panelists, only “outcomes from group problem solving activities” 
had a standard deviation (SD) of < 1.00. For all the other items the SD was 
> 2.00. Although as a group the items are highly rated, the relatively large SD 
for these assessment methods suggested that there is little agreement among 
panelists as to the perceived relevance of these methods. Panelists' ratings of 
these items is presented in Table 3. 

The comments on the items run somewhat contrary to the item ratings. 
Panelists expressed reservations about all but the three most highly ranked 
items. Several panelists were concerned about the “school smarts” of students. 
One panel member commented that structured interviews might not be a viable 
way to get at program effectiveness because “students know which answers are 
valued by the teacher.” Panelists rankings and comments indicated a need for 
specific observable measures from which to assess the effectiveness of problem 
solving capabilities. 
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Table 3 

Methods for the Assessment of Program Effectiveness in Delivering the Proce¬ 
dures Recommended to Develop Technological Problem Solving 
Capabilities 


Mean 

SD 

Recommended Assessment Method 

8.83 

0.78 

Outcomes from group problem solving 
activities 

8.39 

2.23 

Performance samples of a specific problem 
solving phase 

8.11 

2.35 

Examples of problem solving by the teacher 

7.94 

2.38 

Written or verbal rationales for decisions 

7.37 

2.26 

Structured interviews 

7.00 

2.27 

Holistic scoring (points awarded for each 
stage of the problem solving process) 

6.95 

2.06 

Informal questioning during instructional 
activities 

6.47 

2.30 

Teacher self-inventories of their problem 
solving abilities 


Training Teachers to Use Problem Solving Teaching Methods 

Procedures that promote the use of problem solving teaching methods. 
Ten of the 11 items in this section had a mean rating > 7.89. The limited range 
of the mean scores and the high mean ratings of the items indicate that the 
procedures have a high degree of relevance in assisting pre-service technology 
education teachers in using a problem solving teaching methods. Visual cat¬ 
egorization of the procedures suggests that the principal instructional compo¬ 
nent in promoting the use of the problem solving approach are: (a) practice with 
multiple forms of feedback, (b) opportunities to regularly observe the modeling 
of problem solving instruction and the associated cognitive processes, and (c) 
reflection upon the application of problem solving instruction in the classroom. 
The tabulated results of the items in this category are presented in Table 4. 

Panelists provided extensive comments on the items in this section and 
typically elaborated upon an item or sought to combine ideas. For example, 
one panelist highlighted the importance of mediated observation 

Table 4 

Instructional Procedures Recommended to Promote the Use of Problem Solving 
Teaching Methods 

Mean SD Recommended Procedure 

9.00 1.00 Problem solving theory is specifically linked 

to classroom practices of teachers. 
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9.00 

1.32 

Teachers receive multiple forms of feedback 
on their use of the problem solving approach 
(e.g. instructors, videotapes, and supervisory 
conferences) 

9.00 

1.49 

Problem solving instructional methods are 
regularly modeled 

8.89 

1.10 

Teachers evaluate their own problem solving 
strategies and discuss their application to 
the teaching of children 

8.63 

1.64 

Thinking processes used to facilitate problem 
solving instruction are regularly modeled 
through “talk aloud" strategies and self¬ 
monitoring questions 

8.53 

1.68 

Teachers participate in the systematic 
observation of problem solving practices 
in the classroom and laboratory 

8.42 

1.61 

Steps that comprise the problem solving 
approach are clearly defined and practiced 
in a microteaching environment 

8.26 

2.05 

Coaching in the use of problem solving 
methods is gradually reduced as teacher 
competence increases 

8.22 

1.26 

Lesson planning accounts for individual 
differences in students' problem solving 
abilities such as the confidence and 
competence of the problem solvers 

7.89 

2.13 

Pre-service problem solving activities are 
similar to those that teachers will present 
to their technology education students 

6.78 

2.23 

Teachers predict and visualize the outcomes 


of lesson planning 


and multiple forms of feedback by stating that, “Any type of feedback can be 
useful, but it must be articulated feedback with specific suggestions for im¬ 
provement. Even in looking at a videotape, someone usually has to point out 
what to watch for.” 

Teaching methods. With the exception of lecture and case study, which 
had mean scores of 5.21 and 6.84 respectively, the mean scores of the other 
eight instructional techniques fell within a limited range from 7.53 to 9.11 on 
the 10-point scale. Student teaching was the highest rated technique in this 
group and the only item with a mean score > 9.00. Panelists' ratings of these 
items are reported in Table 5. 

Comments by panel members suggested that choice of technique is not 
necessarily as critical as factors related to the implementation of the technique, 
such as frequency of use or appropriate sequencing during the teacher education 
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program. While student teaching was the most highly ranked technique, several 
panelists commented that this experience would only be useful if the cooperat¬ 
ing teachers were carefully selected. 

Table 5 

Instructional Techniques for the Implementation of the Instructional 
Procedures Recommended to Promote the Use of Problem Solving 
Teaching Methods 


Mean SD Recommended Procedure 


9.11 

1.37 

Student teaching 

8.72 

1.41 

Induction year 

8.50 

1.46 

Simulation 

8.39 

1.61 

Cooperative learning 

8.16 

1.46 

Micro-teaching 

8.00 

1.56 

Demonstration 

7.79 

1.58 

Peer teaching 

7.53 

2.11 

Discussion 

6.84 

3.07 

Case study 

5.21 

2.59 

Lecture 


Assessment of program effectiveness. Although there were only five 
items in this section, a visual examination of the mean responses indicated two 
groups of assessment methods. The two most highly rated items, systematic 
observation of teacher performance during student teaching (9.00) and focused 
interviews (8.21), emphasized a structured approach to assessment. The re¬ 
maining items relied on more indirect measures or self-report to assess teachers' 
use of problem solving teaching methods. 

The comments of panelists reflected a general skepticism of any form of 
assessment based on self-report by the learner. Additionally, comments rein¬ 
forced the need for assessment methods to be based on observed performance 
that can be checked against established benchmarks. The tabulated responses 
to the items in this section are presented in Table 6. 

Table 6 


Methods for the Assessment of Program Effectiveness in Delivering the Proce¬ 
dures Recommended to Promote the Use of Problem Solving 
Methodologies 


Mean 

SD 

Recommended Procedure 

9.00 

1.37 

Systematic observation of teacher perform¬ 
ance during student teaching 

8.21 

1.68 

Focused interviews 

7.00 

1.45 

Children's performance during teachers' field 
experience (student teaching) 
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6.89 2.60 Journal reports from student teaching 

6.79 2.37 Informal questioning during instructional 

activities 


Additional Procedures Suggested by Panelists 

Panelists suggested 46 additional procedures which they considered es¬ 
sential for the development of the problem solving capabilities. Combining the 
individual suggestions resulted in a listing of 25 additional items. A pilot test 
to validate the relevance of these additional procedures was conducted as an 
adjunct to this study. On a mailed questionnaire, panelists were asked to rate 
the additional procedures. The questionnaire format and item rating procedures 
used in the pilot test were identical to those processes used during the initial 
interviews. Eighteen of the panelists (94.7%) returned rating sheets. Analysis 
of the data indicated similarities in skewness, mean rating scores, and standard 
deviations between the additional procedures and the procedures recommended 
through the review of literature. Therefore, the additional procedures also ap¬ 
pear to be relevant to development of problem solving capabilities. However, 
because of methodological differences only selected items will be discussed. 

Technological problem solving. The most highly ranked instructional 
procedure, 9.11 on the 10-point scale, suggested that “Alternative ways of 
looking at the problem should be considered in the search for a solution.” Al¬ 
though this item appears to be a step in the technological problem solving 
process, it is also consistent with the information processing concept of looking 
for a representation of the problem that makes a solution more likely. The 
modeling of “looking for alternatives” as technical problems are addressed may 
be a large step in promoting a problem solving thinking approach. 

In the assessment section, if “Instructor models problem solving 
behavior” had been considered among the initial group of inventory items, it 
would have been the most highly rated item (mean rating = 8.89). Moreover, 
this was the only assessment method that did not relate program effectiveness 
in the delivery of problem solving instruction to some measure of learner out¬ 
come. Perhaps evidence of instructor modeling of problem solving behaviors 
is a powerful indicator of program effectiveness. 

Training teachers to use problem solving teaching methods. The in¬ 
structional procedures and techniques suggested in this section tended to elab¬ 
orate on the more general items recommended in the initial inventory. Many 
of the items focused on some aspect of observational activity or field experi¬ 
ence. However, the two most highly rated methods for the assessment of pro¬ 
gram effectiveness are clearly different from the items in the initial inventory. 
One suggested that, “Teachers analyze videotaped segments of their actual 
teaching or micro-teaching” (mean rating = 7.94), whereas the second item re¬ 
commended that, “Teachers analyze situations presented on videotape or 
videodisc in relation to specific program goals” (mean rating = 7.06). The use 
of these two methods may offer a controlled way to systematically examine 
program outcomes. 
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Summary and Conclusions 

The inventory of procedures was highly rated by panelists and the incre¬ 
ments between adjacent rankings were too small to establish meaningful cut-off 
points. Therefore no attempt was made to categorize the items within the 
sections. Clearly, in the correct context, all of the items may contribute 
synergically to the development of effective problem solving instruction. Given 
the small mean differences between adjacent rankings in the inventory, in¬ 
structors and curriculum designers are advised to consider the procedures within 
each section as a group, and select procedures based on instructional objectives 
and situational context. Further, as indicated by panelists comments, factors 
such as the frequency of use and appropriateness of the procedures or tech¬ 
niques at the learners' current stage of development must obviously be consid¬ 
ered. 

In general, the ratings and comments by panelists indicated that the de¬ 
velopment of technological problem solving capabilities was typified by: (a) 
modeling and practice with feedback in realistic situations, (b) a variety of 
relevant instructional techniques, and (c) a collection of outcome measures to 
assess program effectiveness. Additionally, training teachers to use problem 
solving teaching methods involved: (a) modeling, mediated observation, spe¬ 
cific practice with feedback in using problem solving teaching methods, and 
reflective discussion on the application of these teaching methods; (b) carefully 
selected field experience sites; and (c) performance based assessment. Specif¬ 
ically, the following conclusions were derived from this study: 

1. The inventory of instructional procedures, techniques, and assessment 
methods compiled and rated through this research provide a relevant 
framework for the development of the problem solving capabilities in 
pre-service technology teacher education. 

2. Procedures and methods advocated by technology teacher educators were 
not significantly different from those recommended by the EXT panel of 
authors and educational psychologists. Therefore, it makes sense to utilize 
the expertise within the field of technology education when designing in¬ 
struction intended to facilitate problem solving capabilities. 

3. Instructional procedures that characterized the development of technolog¬ 
ical problem solving capabilities included the: (a) application of problem 
solving strategies with appropriate feedback in variety of realistic situ¬ 
ations, (b) observation of behavioral and cognitive modeling, and (c) de¬ 
velopment of connections between concepts and applications. 

4. Although “small group problem solving” was the most highly ranked in¬ 
structional technique for the development of technological problem solving 
capabilities, panelist considered it appropriate and desirable to employ a 
variety of techniques. 

5. Methods for the assessment of program effectiveness in delivering tech¬ 
nological problem solving instruction included: (a) outcomes from group 
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and individual problem solving activities, (b) performance samples, and 
(c) self-reports. 

6. Instructional procedures that promote the use of problem solving teaching 
methods included: (a) the development of linkages between theory and 
practice, (b) multiple forms of feedback on practice teaching activities, (c) 
modeling of appropriate methods, and (d) mediated observation of problem 
solving instruction and reflective discussion on the application of those 
teaching methods. 

7. Field experience that is conducted in carefully selected sites and that em¬ 
phasizes problem solving teaching methods was identified as the most ef¬ 
fective means of training pre-service teachers to use those teaching 
methods. 

8. Systematic observation of teachers' performance during student teaching 
was the most highly rated method for the assessment of program effec¬ 
tiveness in promoting the use of problem solving teaching methods. 

Implications for Technology Teacher Education 

Technology education teachers need to develop technical expertise, 
problem solving skills, and the ability to foster the problem solving skills of 
their students. These abilities will not likely occur by chance. The competen¬ 
cies needed to teach problem solving must be taught to prospective teachers. 
The inventory of procedures validated in this study may form a useful set of 
recommendations for practice. These recommendations may serve to guide the 
selection of instructional practices, the development of curriculum, and the as¬ 
sessment of problem solving instruction in pre-service technology teacher edu¬ 
cation. Based on appropriate sections of the inventory, checklists may be 
developed to provide a formative assessment of the problem solving teaching 
methods used by instructors or to guide specific feedback to practice teachers. 
Research indicates that changes in ways of preparing teachers will result in 
changes in classroom performance. The challenge to technology teacher edu¬ 
cators is to select and implement the most effective teaching procedures. 
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